Speed-accuracy Trade-off Function Research Articles

Measuring and monitoring skill learning in closed-loop myoelectric hand prostheses using speed-accuracy tradeoffs

Objective. Closed-loop myoelectric prostheses, which combine supplementary sensory feedback and electromyography (EMG) based control, hold the potential to narrow the divide between natural and bionic hands. The use of these devices, however, requires dedicated training. Therefore, it is crucial to develop methods that quantify how users acquire skilled control over their prostheses to effectively monitor skill progression and inform the development of interfaces that optimize this process. Approach. Building on theories of skill learning in human motor control, we measured speed-accuracy tradeoff functions (SAFs) to comprehensively characterize learning-induced changes in skill—as opposed to merely tracking changes in task success across training—facilitated by a closed-loop interface that combined proportional control and EMG feedback. Sixteen healthy participants and one individual with a transradial limb loss participated in a three-day experiment where they were instructed to perform the box-and-blocks task using a timed force-matching paradigm at four specified speeds to reach two target force levels, such that the SAF could be determined. Main results. We found that the participants’ accuracy increased in a similar way across all speeds we tested. Consequently, the shape of the SAF remained similar across days, at both force levels. Further, we observed that EMG feedback enabled participants to improve their motor execution in terms of reduced trial-by-trial variability, a hallmark of skilled behavior. We then fit a power law model of the SAF, and demonstrated how the model parameters could be used to identify and monitor changes in skill. Significance. We comprehensively characterized how an EMG feedback interface enabled skill acquisition, both at the level of task performance and movement execution. More generally, we believe that the proposed methods are effective for measuring and monitoring user skill progression in closed-loop prosthesis control.

The role of underspecification in relative clause attachment: Speed-accuracy tradeoff evidence.

A number of studies have found evidence for the so-called ambiguity advantage, that is, faster processing of ambiguous sentences compared with unambiguous counterparts. While a number of proposals regarding the mechanism underlying this phenomenon have been made, the empirical evidence so far is far from unequivocal. It is compatible with several theories, including strategic underspecification (Swets et al., 2008), race models (Logačev & Vasishth, 2016; Van Gompel et al., 2000), and a more recent coactivation-based account (Dillon et al., 2019). While all three classes of theories make matching predictions for the average time to complete relative clause (RC) attachment in ambiguous compared with unambiguous sentences, their predictions diverge with regard to the minimum completion times. The speed-accuracy tradeoff procedure was used to test the predictions of all three classes of theories. According to a hierarchical Bayesian model, the speed-accuracy tradeoff functions (SATFs) for ambiguous RC attachment conditions show an earlier departure from chance performance than in either high or low attachment conditions. The results further indicate increased asymptotic accuracy in the ambiguous condition but no increase in processing rate. Taken together, this pattern of results is compatible with the strategic underspecification model and coactivation-based accounts, but not with race models. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Bayesian adaptive method for estimating speed-accuracy tradeoff functions of multiple task conditions.

The speed-accuracy tradeoff (SAT) often makes psychophysical data difficult to interpret. Accordingly, the SAT experimental procedure and model were proposed for an integrated account of the speed and accuracy of responses. However, the extensive data collection for a SAT experiment has blocked its popularity. For a quick estimation of SAT function (SATf), we previously developed a Bayesian adaptive SAT method, including an online stimulus selection strategy. By simulations, the method was proved efficient with high accuracy and precision with minimal trials, adequate for practically applying a single condition task. However, it calls for extensions to more general designs with multiple conditions and should be revised to achieve improved estimation performance. It also demands real experimental validation with human participants. In the current study, we suggested an improved method to measure SATfs for multiple task conditions concurrently and to enhance robustness in general designs. The performance was evaluated with simulation studies and a psychophysical experiment using a flanker task. Simulation results revealed that the proposed method with the adaptive stimulus selection strategy efficiently estimated multiple SATfs and improved performance even for cases with an extreme parameter value. In the psychophysical experiment, SATfs estimated by minimal adaptive trials (1/8 of conventional trials) showed high agreement with those by conventional trials required for reliably estimating multiple SATfs. These results indicate that the Bayesian adaptive SAT method is reliable and efficient in estimating SATfs in most experimental settings and may apply to SATf estimation in general behavioral research designs.

Estimating speed-accuracy trade-offs to evaluate and understand closed-loop prosthesis interfaces

Objective. Closed-loop prosthesis interfaces, which combine electromyography (EMG)-based control with supplementary feedback, represent a promising direction for developing the next generation of bionic limbs. However, we still lack an understanding of how users utilize these interfaces and how to evaluate competing solutions. In this study, we used the framework of speed–accuracy trade-off functions (SAF) to understand, evaluate, and compare the performance of two closed-loop user-prosthesis interfaces. Approach. Ten able-bodied participants and an amputee performed a force-matching task in a functional box-and-block setup at three different speeds. All participants were subjected to both interfaces in a crossover study design with a 1 week washout period. Importantly, both interfaces used direct proportional control but differed in the feedback provided to the participant (EMG feedback vs. Force feedback). We estimated the SAFs afforded by the two interfaces and sought to understand how the participants planned and executed the task under the various conditions. Main results. We found that execution speed significantly influenced performance, and that EMG feedback afforded better overall performance, especially at medium speeds. Notably, we found that there was a difference in the SAF between the two interfaces, with EMG feedback enabling participants to attain higher accuracies faster than Force feedback. Furthermore, both interfaces enabled participants to develop flexible control policies, while EMG feedback also afforded participants the ability to generate smoother, more repeatable EMG commands. Significance. Overall, the results indicate that the performance of closed-loop prosthesis interfaces depends critically on the feedback approach and execution speed. This study showed that the SAF framework could be used to reveal the differences between feedback approaches, which might not have been detected if the assessment was performed at a single speed. Therefore, we argue that it is important to consider the speed–accuracy trade-offs to rigorously evaluate and compare user-prosthesis interfaces.

Bayesian adaptive model estimation to solve the speed accuracy tradeoff problem in psychophysical experiments

Most psychological experiments measure human cognitive function through the response time and accuracy of the response to a set of stimuli. Since response time and accuracy complement each other, it is often difficult to interpret cognitive performance based on only one dependent measurement and raises a speed-accuracy tradeoff (SAT) problem. In overcoming this problem, SAT experimental paradigms and models that integrate response time and accuracy have been proposed to understand information processing in human cognitive function. However, due to a lengthy SAT experiment for reliable model estimation, SAT experiments' practical limitations have been pointed out. Thus, these limitations call for an efficient technique to shorten the number of trials required to estimate the SAT function reliably. Instead of using a block's stimulus-onset asynchrony (SOA) accuracy with long block-based task trials, we introduced a Bayesian SAT function estimation using trial-by-trial response time and correctness, which makes SAT tasks flexible and easily extendable to multiple trials. We then proposed a Bayesian adaptive method to select optimal SOA by maximizing information gain to estimate model parameters. Simulation results showed that the proposed Bayesian adaptive estimation was highly efficient and robust for accuracy and precision of estimating SAT function by enabling "multiple-step ahead search."

Does Timbre Modulate Visual Perception? Exploring Crossmodal Interactions

Musical timbre is often described using terms from non-auditory senses, mainly vision and touch; but it is not clear whether crossmodality in timbre semantics reflects multisensory processing or simply linguistic convention. If multisensory processing is involved in timbre perception, the mechanism governing the interaction remains unknown. To investigate whether timbres commonly perceived as “bright-dark” facilitate or interfere with visual perception (darkness-brightness), we designed two speeded classification experiments. Participants were presented consecutive images of slightly varying (or the same) brightness along with task-irrelevant auditory primes (“bright” or “dark” tones) and asked to quickly identify whether the second image was brighter/darker than the first. Incongruent prime-stimulus combinations produced significantly more response errors compared to congruent combinations but choice reaction time was unaffected. Furthermore, responses in a deceptive identical-image condition indicated subtle semantically congruent response bias. Additionally, in Experiment 2 (which also incorporated a spatial texture task), measures of reaction time (RT) and accuracy were used to construct speed-accuracy tradeoff functions (SATFs) in order to critically compare two hypothesized mechanisms for timbre-based crossmodal interactions, sensory response change vs. shift in response criterion. Results of the SATF analysis are largely consistent with the response criterion hypothesis, although without conclusively ruling out sensory change.

Cocaine-specific speed-accuracy trade-off during anti-saccade testing differentiates patients with cocaine use disorder who achieve initial abstinence during treatment.

The response time speed-accuracy trade-off (SATO) is an established index of information processing ability, but rarely examined as a variable in association with treatment of substance use disorder (SUD). The purpose of this study was to test baseline information-processing ability differences between individuals who respond to treatment for cocaine use disorder v. those who do not. Eighty patients enrolled in a clinical trial for cocaine use disorder completed a baseline drug-specific eye-tracking (anti-saccade) assessment prior to treatment, which included trials with both cocaine-related and neutral stimuli. SATO functions were computed for treatment responders v. non-responders. Unexpectedly, responders demonstrated statistically different SATO functions, showing poorer accuracy when executing faster response times. This difference was present on trials that presented cocaine stimuli only. SATO during performance of an eye-movement task may be useful for predicting differential response to substance use disorder treatment. However, in the present study, results were specific to cocaine cues rather than an overall SATO performance decrement.

Not all Speed-Accuracy Trade-Off Manipulations Have the Same Psychological Effect

In many domains of psychological research, decisions are subject to a speed-accuracy trade-off: faster responses are more often incorrect. This trade-off makes it difficult to focus on one outcome measure in isolation – response time or accuracy. Here, we show that the distribution of choices and response times depends on specific task instructions. In three experiments, we show that the speed-accuracy trade-off function differs between two commonly used methods of manipulating the speed-accuracy trade-off: Instructional cues that emphasize decision speed or accuracy and the presence or absence of experimenter-imposed response deadlines. The differences observed in behavior were driven by different latent component processes of the popular diffusion decision model of choice response time: instructional cues affected the response threshold, and deadlines affected the rate of decrease of that threshold. These analyses support the notion of an “urgency” signal that influences decision-making under some time-critical conditions, but not others.

Studying the dynamics of visual search behavior using RT hazard and micro-level speed-accuracy tradeoff functions: A role for recurrent object recognition and cognitive control processes.

Thanks to the work of Anne Treisman and many others, the visual search paradigm has become one of the most popular paradigms in the study of visual attention. However, statistics like mean correct response time (RT) and percent error do not usually suffice to decide between the different search models that have been developed. Recently, to move beyond mean performance measures in visual search, RT histograms have been plotted, theoretical waiting time distributions have been fitted, and whole RT and error distributions have been simulated. Here we promote and illustrate the general application of discrete-time hazard analysis to response times, and of micro-level speed-accuracy tradeoff analysis to timed response accuracies. An exploratory analysis of published benchmark search data from feature, conjunction, and spatial configuration search tasks reveals new features of visual search behavior, such as a relatively flat hazard function in the right tail of the RT distributions for all tasks, a clear effect of set size on the shape of the RT distribution for the feature search task, and individual differences in the presence of a systematic pattern of early errors. Our findings suggest that the temporal dynamics of visual search behavior results from a decision process that is temporally modulated by concurrently active recurrent object recognition, learning, and cognitive control processes, next to attentional selection processes.

Fast and specific: insights into the acquisition and generalization of motor acuity.

Motor acuity is considered to be the outcome of prolonged practice and to involve morphological changes in the motor cortex. We have previously designed a curved pointing task, the arc pointing task (APT), to study motor acuity acquisition, defined as a change in the speed-accuracy tradeoff function (SAF) of the task. Here, we studied the generalization of motor acuity between hands and between tasks (drawing the arc in the opposite direction and with the untrained hand) and the effect of training duration on motor acuity. We report that training-induced motor acuity improvement did not generalize across hands and across tasks performed with the same hand, suggesting a task-specific representation of motor acuity. To our surprise, the largest gains in motor acuity, measured both by changes in SAF and by improvement in multiple kinematic variables, were seen following a short exposure to the task. Our results suggest that motor acuity training-induced improvement is task specific and that motor acuity starts to improve following a very short practice.NEW & NOTEWORTHY We report that training induced motor acuity improvement does not generalize from one hand to another or between movements that are performed with the same effector. Furthermore, significant improvements in acuity were found following a very short exposure to the task (∼20 trials). Therefore, our results suggest that the nervous system has the capacity to rapidly improve motor acuity.

Losing control: Mostly incongruent lists postpone, but do not eliminate, the Stroop effect.

Identifying the color (e.g., red) of a color word that is incongruent (e.g., "BLUE") can be remarkably difficult. The Stroop effect is a measure of the interference between activity from word and color pathways. The efficacy of these pathways is thought to be highly contingent on the frequency of incongruent trials within a block. A block of trials with mostly incongruent (MI) trials typically results in a smaller Stroop effect than a block with mostly congruent (MC) trials. This reduction of the Stroop effect has been largely attributed to the strategic list-wide control of the word pathway. Here, the time course of the Stroop effect was explored using speed-accuracy tradeoff functions (SATfs) in tasks with 50 % congruent, MC, and MI trials. In the MC and 50 % congruent condition, color-word congruency affected the rate parameter of the SATf. In the MI condition, however, congruency affected the asymptote. This evidence is consistent with the idea that the strategic control of the word pathway is an effortful, temporary phenomenon, prone to buckle if responding is held in check.

Transcranial direct current stimulation over multiple days enhances motor performance of a grip task

BackgroundRecovery of handgrip is critical after stroke since it is positively related to upper limb function. To boost motor recovery, transcranial direct current stimulation (tDCS) is a promising, non-invasive brain stimulation technique for the rehabilitation of persons with stroke. When applied over the primary motor cortex (M1), tDCS has been shown to modulate neural processes involved in motor learning. However, no studies have looked at the impact of tDCS on the learning of a grip task in both stroke and healthy individuals. ObjectiveTo assess the use of tDCS over multiple days to promote motor learning of a grip task using a learning paradigm involving a speed-accuracy tradeoff in healthy individuals. MethodsIn a double-blinded experiment, 30 right-handed subjects (mean age: 22.1±3.3 years) participated in the study and were randomly assigned to an anodal (n=15) or sham (n=15) stimulation group. First, subjects performed the grip task with their dominant hand while following the pace of a metronome. Afterwards, subjects trained on the task, at their own pace, over 5 consecutive days while receiving sham or anodal tDCS over M1. After training, subjects performed de novo the metronome-assisted task. The change in performance between the pre and post metronome-assisted task was used to assess the impact of the grip task and tDCS on learning. ResultsAnodal tDCS over M1 had a significant effect on the speed-accuracy tradeoff function. The anodal tDCS group showed significantly greater improvement in performance (39.28±15.92%) than the sham tDCS group (24.06±16.35%) on the metronome-assisted task, t(28)=2.583, P=0.015 (effect size d=0.94). ConclusionsAnodal tDCS is effective in promoting grip motor learning in healthy individuals. Further studies are warranted to test its potential use for the rehabilitation of fine motor skills in stroke patients.

Modelling individual response time effects between and within experimental speed conditions: A GLMM approach for speeded tests

Completing test items under multiple speed conditions avoids the performance measure being confounded with individual differences in the speed-accuracy compromise, and offers insights into the response process, that is, how response time relates to the probability of a correct response. This relation is traditionally represented by two conceptually different functions: the speed-accuracy trade-off function (SATF) across conditions relating the condition average response time to the condition average of accuracy, and the conditional accuracy function (CAF) within a condition describing accuracy conditional on response time. Using a generalized linear mixed modelling approach, we propose an item response modelling framework that is suitable for item response and response time data from experimental speed conditions. The proposed SATF and CAF model accommodates response time effects between conditions (i.e., person and item SATF slope) and within conditions (i.e., residual CAF slopes), captures person and item differences in these effects, and is suitable for measures with a strong speed component. Moreover, for a single condition a CAF model is proposed distinguishing person, item and residual CAF. The properties of the models are illustrated with an empirical example.

Effect of Experimental Hand Pain on Training-Induced Changes in Motor Performance and Corticospinal Excitability.

Pain influences plasticity within the sensorimotor system and the aim of this study was to assess the effect of pain on changes in motor performance and corticospinal excitability during training for a novel motor task. A total of 30 subjects were allocated to one of two groups (Pain, NoPain) and performed ten training blocks of a visually-guided isometric pinch task. Each block consisted of 15 force sequences, and subjects modulated the force applied to a transducer in order to reach one of five target forces. Pain was induced by applying capsaicin cream to the thumb. Motor performance was assessed by a skill index that measured shifts in the speed–accuracy trade-off function. Neurophysiological measures were taken from the first dorsal interosseous using transcranial magnetic stimulation. Overall, the Pain group performed better throughout the training (p = 0.03), but both groups showed similar improvements across training blocks (p < 0.001), and there was no significant interaction. Corticospinal excitability in the NoPain group increased halfway through the training, but this was not observed in the Pain group (Time × Group interaction; p = 0.01). These results suggest that, even when pain does not negatively impact on the acquisition of a novel motor task, it can affect training-related changes in corticospinal excitability.

Application of the Alpha Shape Method to Visualize and Analyze Surgical Motion

Simulators play an important role in training surgery residents to perform laparoscopy surgery. Some of these simulators have the capability to track tool motion to assess performance. However, most have not utilized the data to analyze trainee performance in a meaningful way. The alpha shape method can be used to construct a geometric surface based on motion data to enable visualization of the performance, while the surface derivative (surface/time to completion)—efficiency—can be used as a metric to evaluate complex surgical performance. The utility of the alpha shape method was demonstrated in a pick-and-place task, where the motion path of laparoscopic graspers was recorded by a position sensor, miniBIRD 500®. An alpha shape method was used to measure the surface area of the 3D points in space occupied by the tool tips during task performance. Results show that the surface derivative measure alone may be able to model the speed-accuracy tradeoff function, thereby simplifying the analysis and evaluation of complex motion in surgical performance.

Motor Learning in Stroke

Background and Objective: Stroke rehabilitation assumes motor learning contributes to motor recovery, yet motor learning in stroke has received little systematic investigation. Here we aimed to illustrate that despite matching levels of performance on a task, a trained patient should not be considered equal to an untrained patient with less impairment. Methods: We examined motor learning in healthy control participants and groups of stroke survivors with mild-to-moderate or moderate-to-severe motor impairment. Participants performed a series of isometric contractions of the elbow flexors to navigate an on-screen cursor to different targets, and trained to perform this task over a 4-day period. The speed-accuracy trade-off function (SAF) was assessed for each group, controlling for differences in self-selected movement speeds between individuals. Results: The initial SAF for each group was proportional to their impairment. All groups were able to improve their performance through skill acquisition. Interestingly, training led the moderate-to-severe group to match the untrained (baseline) performance of the mild-to-moderate group, while the trained mild-to-moderate group matched the untrained (baseline) performance of the controls. Critically, this did not make the two groups equivalent; they differed in their capacity to improve beyond this matched performance level. Specifically, the trained groups had reached a plateau, while the untrained groups had not. Conclusions: Despite matching levels of performance on a task, a trained patient is not equal to an untrained patient with less impairment. This has important implications for decisions both on the focus of rehabilitation efforts for chronic stroke, as well as for returning to work and other activities.

Reduced asymmetry in motor skill learning in left-handed compared to right-handed individuals

Hemispheric specialization for motor control influences how individuals perform and adapt to goal-directed movements. In contrast to adaptation, motor skill learning involves a process wherein one learns to synthesize novel movement capabilities in absence of perturbation such that they are performed with greater accuracy, consistency and efficiency. Here, we investigated manual asymmetry in acquisition and retention of a complex motor skill that requires speed and accuracy for optimal performance in right-handed and left-handed individuals. We further determined if degree of handedness influences motor skill learning. Ten right-handed (RH) and 10 left-handed (LH) adults practiced two distinct motor skills with their dominant or nondominant arms during separate sessions two–four weeks apart. Learning was quantified by changes in the speed–accuracy tradeoff function measured at baseline and one-day retention. Manual asymmetry was evident in the RH group but not the LH group. RH group demonstrated significantly greater skill improvement for their dominant-right hand than their nondominant-left hand. In contrast, for the LH group, both dominant and nondominant hands demonstrated comparable learning. Less strongly-LH individuals (lower EHI scores) exhibited more learning of their dominant hand. These results suggest that while hemispheric specialization influences motor skill learning, these effects may be influenced by handedness.

A Single Bout of Moderate Aerobic Exercise Improves Motor Skill Acquisition.

Long-term exercise is associated with improved performance on a variety of cognitive tasks including attention, executive function, and long-term memory. Remarkably, recent studies have shown that even a single bout of aerobic exercise can lead to immediate improvements in declarative learning and memory, but less is known about the effect of exercise on motor learning. Here we sought to determine the effect of a single bout of moderate intensity aerobic exercise on motor skill learning. In experiment 1, we investigated the effect of moderate aerobic exercise on motor acquisition. 24 young, healthy adults performed a motor learning task either immediately after 30 minutes of moderate intensity running, after running followed by a long rest period, or after slow walking. Motor skill was assessed via a speed-accuracy tradeoff function to determine how exercise might differentially affect two distinct components of motor learning performance: movement speed and accuracy. In experiment 2, we investigated both acquisition and retention of motor skill across multiple days of training. 20 additional participants performed either a bout of running or slow walking immediately before motor learning on three consecutive days, and only motor learning (no exercise) on a fourth day. We found that moderate intensity running led to an immediate improvement in motor acquisition for both a single session and on multiple sessions across subsequent days, but had no effect on between-day retention. This effect was driven by improved movement accuracy, as opposed to speed. However, the benefit of exercise was dependent upon motor learning occurring immediately after exercise–resting for a period of one hour after exercise diminished the effect. These results demonstrate that moderate intensity exercise can prime the nervous system for the acquisition of new motor skills, and suggest that similar exercise protocols may be effective in improving the outcomes of movement rehabilitation programs.

Fast perception of binocular disparity.

Is depth perception from binocular disparities-stereopsis-slow or fast? Many of the temporal properties of stereopsis are known. For example, rapidly changing disparities are perceptually difficult to track, which suggests that stereopsis is generally slow. But, remarkably, this basic question has not yet been addressed. We compared speed-accuracy trade-off functions between 2 forced-choice discriminations: 1 based on stereoscopic depth and 1 based on luminance. Unexpectedly, both speed-accuracy trade-off functions deviated from chance levels of accuracy at the same response time-approximately 200 ms-with stereo accuracy increasing, on average, more slowly than luminance accuracy after this initial delay. Thus, the initial processing of disparity for perceived depth took no longer than the initial processing of luminance for perceived brightness. This finding, that binocular disparities are available early during visual processing, means that depth is perceived quickly, and, intriguingly, that disparities may be more important for everyday visual function than previously thought.

Fast perception of binocular disparity

Is depth perception from binocular disparities-stereopsis-slow or fast? Many of the temporal properties of stereopsis are known. For example, rapidly changing disparities are perceptually difficult to track, which suggests that stereopsis is generally slow. But, remarkably, this basic question has not yet been addressed. We compared speed-accuracy trade-off functions between 2 forced-choice discriminations: 1 based on stereoscopic depth and 1 based on luminance. Unexpectedly, both speed-accuracy trade-off functions deviated from chance levels of accuracy at the same response time-approximately 200 ms-with stereo accuracy increasing, on average, more slowly than luminance accuracy after this initial delay. Thus, the initial processing of disparity for perceived depth took no longer than the initial processing of luminance for perceived brightness. This finding, that binocular disparities are available early during visual processing, means that depth is perceived quickly, and, intriguingly, that disparities may be more important for everyday visual function than previously thought.